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ABSTRACT 

There is a growing^ need for program evaluation in the 
human services field. Along with this is a need to assess 
environments in order to plan effective programs* Graduate programs 
are doing little to prepare students for this task. Instead of 
training students Kow to do evaluation, graduate programs stubbornly 
adhere to the experimental research-scientist model* Research 
generates further research with little ^fect upon clinical practice* 
An alternate training paradigm based on the scientist-practitioner 
model is necessary. If evaluators are to be successful, they need a 
knowledge in. program evaluation, 'environmental assessment, political 
processes, organizational theory, and research design* Evaluators 
also need interpersonal skills* Will graduate training me_et the . 



challenge of ^!ie 70' s and 
environmental assessment? 



train students 
(Author) 



in program evaluation and 
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The Student* Development Series is published by the University 
Counseling Center, Colorado State University, Fort Collins, Colorado 
80521. It is directed to the interest of counselors, psychologists, 
and other student development professionals as welj as administrators, 
faquV^y and students in higher education. Contributions to the Series 
are made by menders of 'the Colorado State University community. ~7fie 
Series include Studqnt Development Reports , which are reports' of a 
research or program evaluation nature, and Student Development Staff 
Papers , which relate^ theoretical or philosophical issues. A listing 
of prior Reports and Staff Papers is presented at the conclusion of 
this issue. \ . 



The cover depicts man's striving toward unity of personality, 
represented by the magic circle, or manual a. , t 
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By 
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Abstract 



There is a growing need for program evaluation in the human services .field. 
Along with this is a need to assess environments in order to plan effective pro- 
grams. Graduate programs are doing little to prepare students for this task. 
Instead of training students how to do evaluation, graduate programs stubbornly 
adhere to the experimental research-scientist model. Research generates fprther 
research with little effect upon clinical .pract^tf&x^An yiternate training para- * 
digm based on the scientist-practitioner riede?' is necessary. If .evaluators are 
to be successful, they need a knowledge in program evaluation, environmental as- ^ 
sessment, political processes, organizational theory, and research design. Eval- 
uators also need interpersonal skills. 'Will graduate training programs meet the ^ 
challenge of the 70*5 and train students in program evaluation and environmental 
assessment? 
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Training ifv'Nontradit-ional Research 

/ 

Can today's graduate students rise to the challenge of the seventies? If 

^ they do it, it won't be a result of their training. One new frontier confront- 

\ " r ~ ,c • ' -.: — . .— — ' 

Ning psychologisis_of^the. seventies is environmental assessment, planning, and 



evaluation. "Increasing numbers, of. Investigators are wbrking^vigprously_on meth- 
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ods of measurement and analysis in evalluation" . . . probably no other' change is 
being stressed so strongly now in the human field ... Ready or not, evaluation" 
is moving jyp ^front (Davis, 1972 f/ p. 3)." "In addition, it must be recognized 
that evaluative research requires special skills — tjiat it is not simply the 
application of laboratory research to the field — and begin training evaluative 
specialists to meet the needs of action prpgrams (petting and Hawkes, 1974, 
p. ^O^xFew graduate programs prepare students for this task. ' . 

TheWys of abundant monies and rapid proliferation of programs has been' 
left behind with the drive for social programming in the sixties. Gone too is 
the power, influence, and freedom that came with money. The press to be account-' 
t able is now essential rather than gratuitous. If programs and psychologists 
whose livelihood depend on them are to survive, both must demonstrate their ef- - 
fectiveness. This" is a more difficult task than it first appears. In a recent 
article, Campbell claimed that "99 percent of our ameliorative programs have not' 
been evaluated in an interpr^table way (Salasin, 1973, p. 7)." 'Evaluators are 
ill equipped. They luc&Vthe tools-and techniques to confront the problems of ' 

social action research* With present evaluation data, it is difficult to. assess 

'» * * 

program effectiveness . r Campbell admonishes the methodologists "to get down out 

of their ivory towers and produce practical how-to-do-it instruction (Salasin, 
1973, p. 7).". The trainers of- our evaluators, the graduate training programs, 
are implicitly indicted. 

, What are graduate training programs doing to prepare psychology's future * 
leaders? In many instances they are extinguishing a desire to do resea/ch. 

T ' • • 7 
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Statistics haVe become master of the psychologist (S1gnorelli,_ 1974); problems 
-have become subordinate to methodology. "The Insidious effects of this trend 
are tellingly Illustrated by the typical graduate student — whoH-s-often-more — 



The" details irf~w f dcluri ai des iyn than in the pr oblems h e g e t! 



out to study; worse, the selection of the problem is "dTctatedTby the experimental" 
design' (Bergin and Strupp, 1970, p. 25)." Goldman (1973) complains that our , 
field is plagued by the false jgods of pur6 research and bloodless writing. He 
suggests graduate schools and dissertation committees have much to answer for. 

Graduate training programs stubbornly adhere to the experimental research- 
scientist model of training even though reports indicate it extinguishes creati- 
vity and research potential rather than fostering it (Strupp, 1974), For in-^ 
stance, more than 50 percent of graduate Ph.D. 's will do only one major piece of 
research, their dissertation (Proshansky, 1972). Proshansky (1972) states that, 
the doctoral research produced in this model is usually not very good or signif- 
icant and relegated to the bottom shelf. As a result, a small percentage (10%) 
of Division 12 psychologists, for example, produce most (56%) of the research 
(Wake and Harris/ 1970) . Given consequances such as these, Proshansky argues 
that . "as long as our young colleagues cling to the experimental research scien- 

tist self-cortception ... they are not likely to excell in any professional roles 

.* 

they perform (1972, p. 209)." < A , 

If this isn't enough, Raush (1974) also indicts the formal research training 

> X 

model. ,While, there is no dearth of research publication, the consumers I of re- 

'' ' ' * 

Search literature seem to be other researchers. Research generates further re 

•search, and the clinician does not contribute his or her firsthand experiences 
and leadership for studying basic human, processes. Furthermore, the' clinician, 
because of the rejection of the rfesearch model , practice new and divergent the- 
ories without supporting evidence of their validity (Bergin and Strupp, 1970). * 
With this hiatus between research and practice, practicing psychologists lack 
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much useful Information which they might otherwise employ in theif work. "The 

fact is that tp date research has exerted little,, influence 6r\ clinical practice, 

. _ 1 _ \ I 

and the cttn+cf ? work of the ther apist has ^ eneraVly not been U^rmd^miK 

■» y i i _ » * t t - _ fn * — 1 r>j — — 1fl*7A r\ OO \ " 

diLerea uy empirical reswrwi rebuitb ^Derym auu owupy, u/v, y. uuy. — 



What do we ha^e then? .On one hand there Is a strong neea tor researcfrttratr- 
has as its focus program evaluation. A knowledge of^ffw iron mental assessment 1s 



>rpg^ 



also necessary if program implementation is U 



>st effective. These tasks 



are separate specialties which require jtfxher unique skills. This research is 

/ x 1 # I m 

necessary to help the service ,proywers make their interventions more effective. 

There is a need for specialized researchers With the expertise to accomplish 
these tasks. On the other hand, graduate programs s$em reluctant to take leader- 
ship in implementing an applied sfcientist-practiytioner model for their training 
irv research (Paseworlc, et al., H73; Proshansky, ]}972; Raush, 1974; Wolff, 1972). 
They seem intent on preserving the experimental research-scientist model with its 
* corresponding, research dissertation as a sine qua non (Proshapsky, 1972). 
v Society needs environmental assessment, planning and evaluation for its 
social action programs. Many have spoken of this need but: few have responded. 
It is time for our graduate training programs to iegin the task of developing, 
the art and offering 'training for these vital areas. We must recognize that thi.s 
focus of research is highly spej^lTfzed*^hd requires skills many researchers do 
not currently possess {\W0#JA\ Oetting and'Hawkes, 1974). It is important 
that leaders in aur*^programs acknowledge this unique need.and begin the develop- 
ment and implementation of a new paradigm for training based on the tenets of a 
more .applied jcfentist-practitioner model. The model can provide the focus 



jt^ough ^ftlch the scientist and practitioner come closer, enabling both to work 



/' together in a mutually collaborative fashion. 

V The idea is not a new one. It has been suggested by others. Broskowsfci 
and Shulberg (1974; Broskowski, 1971) have suggested a Research and Development 



* « * A 

■ • ' \ ' 

* 

Model.' The R&D person could Interface .the baste sciences and appTi^. fields' "» 

by training "Ph.D. -level psychologists to systematically 'conduct' and utilize 

. ' • 1 I . ' , I ' c ; 

-relevant r e search "far iftfr^tteve4opinefffc L -o f p r oCT d ur e s^ d-4e#<tf^aes^e-fte4f^ 



sulve o r p r event va r ious clinical p r oblems in ind i viduals, g ro upg>_and instUu — — 



"tions (Broskowski, 1971, p. 236). ,r nSbTfTTB7frhas referred~to~tt as-tne-^ — 
'Clinician-Researcher' who could help surmount the chasm between science with 
emphasis on the uniqueness of the individual. Although Oetting (1974), Prosh- 
ansky^972s), and Raush (1974) don't coin a specific title, each agrees that 
it is time for a change to alternative training models. 

What,£fe«r-$he qualifications of the new pioneers if they are to succeed con- 
fronting the tasks ofjhe 70's? / * \ 

(1) The primary prerequisite is an understanding of environmental assess- 
ment and program evaluation. It seems essential to understand that^prpgrams are 
valuable only insofar as they serve people, and not because they are good ideas 
of program developers. It also seems Important to demonstrate the effective- 
ness of specific interventions. In order to accomplish these tasks, conceptual 
models of ^environmental assessment and program evaluation are imperative./* 1 

(2) The evaluator is>redyired to have a knowledge of pcflitical processes. • 
Program evaluation is used in decision making; 1t 1s naive to think otherwise. 
In order to enhance the use of evaluation data the evaluator needs to understand 
very complex political processes. This learning can be provided in the context - 
of a program evaluation practicum in which the trainee can test and see the , 
consequences of program evaluations "The assumption (underlying Program Evalua- \ 

. • I ■ ** 

tion) is that by providing the, facts, evaluation assists decision-makers to make T> . 
wise choices among future courses of action. Careful and unbiased data on the * A 
consequences of programs should improve decision-making. But evaluation is a 
rational enterprise that takes place in a political context (Weiss, 1973, p.37)," ^ 

• 8 ' ' ... * Y 

... .* / •: * 
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(3) The evaluator would be w£ll prepared if he or she , had a knowledge of 
organization, or systems theory. This, coupied with consultation and change 
theory, wtM faciTH ate the^n^ruet^tve use -oE-eva-Hiat4^4a-ta^ „ , 



(4) In addition to cognitive preparation, evaluators will be more abl e if 



~^Bhey trave cerfcafrr p e r s o naF qtMiRT^^ 
1974) . First, and perhaps most crucial, the evaluator needs a iterance for 
ambiguity to work with the various individuals and groups that assis^Mp the 
task of measuring the effectiveness of their work. Secondly, the evaluator n^pds 
to be mature with adequate communication and social skills enabling t^em to work 
construc^-¥*ly with people. It may be important to consider selection criteria 
similar to candidates for clinical work since success of the evaluator will de- 
pend in great part, but not only', on interpersonal skills. 

(5) Oetting (1974) adds that a solid knowledge of research design, instru- 
ment construction, unobtrusive measures and skill in selecting and assessing be- 



havioral outcomes are also ^important. 

In addition to the development of new training paradigm, the graduate pro- / 
grams have their responsibil\ti(s^ They, njust bs flexible enough to accept more 
clinically oriented theses and dissertations. The- "training programs will help 
with the development of more applied scientist-praptitioner programs' if they also 
reward, their staff for their non-traditional research endeavors. "It's been 
this narcissism of pure theory and the reward structure within the academic com-, 
munity that, have produced reluctance. Perhaps to have university departments 
focused on applied social science or to have Institutes for evaluative research 
\ that have their own promotion requirements would relieve these pressures 
- (SaTasin, 1973, P. 7)." This will provide modeling and incentives for faculty 
and students who are inclined to strike out on new paths but need some support. 
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In summary then, one challenge for psychologists in the seventies lies 
with the area of program evaluation and environmental assessment. In many as- 
pects, it is a challenge to the flexibility and adaptability of graduate train- 

% 

t"y ujvy r' diiis. IL dares Il ium lo t r a i n psycholo g ists who will "study problems . . 
■people realty worry abTrat.rather than onty problems formutated on the basis of 
reading \he professional journals (Flint, 1972)." It is everyone's challenge:- 
student, faculty, researcher, clinician. Hopefully, this. Impetus w"1ll free a 
-creative potential that will lead to the enrichment of Individual's lives. 



J 
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